We provide a framework for analyzing the problem of interacting electrons in a ballistic quantum dot with chaotic boundary conditions within an energy $E_T$ (the Thouless energy) of the Fermi energy. Within this window we show that the interactions can be characterized by Landau Fermi liquid parameters. When $g$, the dimensionless conductance of the dot, is large, we find that the disordered interacting problem can be solved in a saddle-point approximation which becomes exact as $g\to\infty$ (as in a large-N theory). The infinite $g$ theory shows a transition to a strong-coupling phase characterized by the same order parameter as in the Pomeranchuk transition in clean systems (a spontaneous interaction-induced Fermi surface distortion), but smeared and pinned by disorder. At finite $g$, the two phases and critical point evolve into three regimes in the $u_m-1/g$ plane -- weak- and strong-coupling regimes separated by crossover lines from a quantum-critical regime controlled by the quantum critical point. In the strong-coupling and quantum-critical regions, the quasiparticle acquires a width of the same order as the level spacing $\Delta$ within a few $\Delta$'s of the Fermi energy due to coupling to collective excitations. In the strong coupling regime if $m$ is odd, the dot will (if isolated) cross over from the orthogonal to unitary ensemble for an exponentially small external flux, or will (if strongly coupled to leads) break time-reversal symmetry spontaneously.